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Abstract 

The indirect RKKY interaction in a layered metal with nearly nested (almost squared) Fermi surface is evaluated 
analytically. The final expressions are obtained in closed form as a combination of Bessel functions. We show that 
the expected "2fcF" oscillations occur as the far asymptote of our expressions, where a value of the effective Fermi 
momentum kp depends on the direction in r— space. We demonstrate the existence of the intermediate asymptote 
of the interaction which is of the sign-reversal antiferromagnetic type. This part of RKKY interaction is the only 
term surviving in the limit of exact nesting. A good accordance of our analytical formulas with numerical findings 
is found until the interatomic distances. 
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The Ruderman-Kittel-Kasuya-Yosida interac- 
tion (RKKY) [1] plays an important role in the 
discussion of the interaction of localized moments 
in a metal through polarization of conduction 
electrons. It is well known that in three spatial di- 
mension and for the spherical Fermi surface (FS) 
this interaction decays as r^^ and has the 2kF 
oscillations with the Fermi momentum kp. In the 
case of anisotropic FSs the RKKY at largest dis- 
tances is characterized by the direction-dependent 
period of oscillations {2kp)~^ and can be repre- 
sented as a series in 1/r. [2] Unfortunately, this 
series diverges at smaller distances k^r ~ 1, where 
the RKKY is mostly significant. 

Nowadays the numerical calculations are a prin- 
cipal tool for the analysis of RKKY in metals with 
non-spherical FS. However the theoretical under- 
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standing is important here even on the qualitative 
level. 

In [3] we developed an analytical approach fo 
the calculation of the RKKY interaction in metals 
with highly anisotropic FS. 

This study was motivated by the experimental 
observations, that the rare-earth (R) subsystem in 
the high- Tc compounds RBa2Cu307_5 undergoes 
a transition to the magnetically ordered antiferro- 
magnetic phase below ^ 1 K. [4] It can be theoret- 
ically shown that the onset of the d— wave super- 
conductivity does not seriously alter the RKKY 
interaction at moderate distances [5]. The main 
anisotropy of RKKY below Tc at those distances 
is thus determined by the anisotropy of the FS in 
the normal state. 

To study the possible character of RKKY in 
high- Tc cuprates, a model of the nearly- nested (al- 
most squared) FS in a layered metal was chosen. 
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We analyzed this case in detail and showed a good 
accordance of our analytical findings with the nu- 
merical results. It turned out that the widely used 
notion of the "2A:f" oscillations could be applied 
to the far asymptote of the interaction. At inter- 
mediate distances the interaction has the sign- 
reversal antiferromagnetic character, and only this 
behaviour survives at the exact nesting of the FS. 
The essence of our method could be outlined as 
follows. The range function of the RKKY interac- 
tion can be represented as a sum over the Matsub- 
ara frequencies ujn — TrT{2n + 1) : 
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with the electronic Green's function G(«cij„,k) — 
[iujn — e(k)]~^. Passing here to r— representation, 
we map the whole vicinity of the FS by the patches 
of the size n of order of inverse interatomic dis- 
tances, where the dispersion £(k) can be approx- 
imated by a simpler form. Such mapping can be 
done for the particular case of the nearly-nested 
FS, when the spectrum has a tight-binding form, 
£(k) — —t{coskx + cos ky) + fi and \fi\ ^ t. One 
distinguishes here the vicinities of the Van Hove 
points (0, ±7r), (±7r, 0) and the flat parts of the 
spectrum near (±7r/2, ±7r/2). It is possible to ob- 
tain a closed form for the partial Green's functions 
stemmed from each of the patches. This form is 
applicable in r— space roughly up to the scale k^^. 
The total Green's function is estimated as a sum 
of the partial ones. 

The square of Green's function in (1) yields 
two types of contributions. First is the prod- 
uct of the partial Green's functions Gj(iw„,r)^ 
from the same patch j. These terms define the 
far asymptote of x(r), established earlier, [2] and 
have the 2kp oscillations. The second contribution 
to x(i") is determined by the interference terms 
Gj{iujn, Y)Gi{iuJm r) with j ^ I. In addition to the 
smooth dependence on r, these latter terms pos- 
sess the overall prefactors exp «(kj — k;)r, with the 
spanning vectors kj — k; connecting the centers of 
the patches k^ and k; . 

For the case of nearly-nested FS the effective 



Fermi momentum k*p does not exceed the value 
■\/|/i/i| <C 1 and vanishes along the diagonals 
Vx — ±^y. It turns out that the interference terms 
G(o.±7r)('*w„,r)G'(±7r,o)(*'^n: r) dominate at the in- 
termediate distances r < (kp)^^ for most of the 
directions of r. The spanning vector between the 
Van Hove points is Q = (tt, tt), thus the commen- 
surate antiferromagnetic modulation expiQr of 
the RKKY is observed. Along the diagonals the 
RKKY interaction is of the ferromagnetic sign, 
and non-oscillatory for moderate r < \t/ fj,\ ; this, 
however, does not determine a particular type of 
magnetic ordering in the subsystem of localized 
moments. 

Our results suggest that definite shapes of the FS 
favor the commensurate antiferromagnetic order- 
ing of localized spins. Particularly, it should take 
place, if the FS lies close to the symmetry points 
of the Brillouin zone, the case relevant to the high- 
Tc cuprates. Thus our findings could explain the 
antiferromagnetism in the subsystem of rare-earth 
ions, systematically observed at low temperatures 
in these compounds. 
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